Saint Martin
Ensembling geophysical models with Bayesian Neural Networks
Ensembles of geophysical models improve prediction accuracy and express uncertainties. We develop a novel data-driven ensembling strategy for combining geophysical models using Bayesian Neural Networks, which infers spatiotem-porally varying model weights and bias, while accounting for heteroscedastic uncertainties in the observations. This produces more accurate and uncertainty-aware predictions without sacrificing interpretability.
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.14)
- North America > Saint Martin (0.04)
- Europe > United Kingdom > England > Lancashire > Lancaster (0.04)
- (5 more...)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Uncertainty > Bayesian Inference (0.68)
- Information Technology > Artificial Intelligence > Machine Learning > Learning Graphical Models (0.68)
Empirical Results for Adjusting Truncated Backpropagation Through Time while Training Neural Audio Effects
Bourdin, Yann, Legrand, Pierrick, Roche, Fanny
This paper investigates the optimization of Truncated Backpropagation Through Time (TBPTT) for training neural networks in digital audio effect modeling, with a focus on dynamic range compression. The study evaluates key TBPTT hyperparameters -- sequence number, batch size, and sequence length -- and their influence on model performance. Using a convolutional-recurrent architecture, we conduct extensive experiments across datasets with and without conditionning by user controls. Results demonstrate that carefully tuning these parameters enhances model accuracy and training stability, while also reducing computational demands. Objective evaluations confirm improved performance with optimized settings, while subjective listening tests indicate that the revised TBPTT configuration maintains high perceptual quality.
- Europe > Italy > Marche > Ancona Province > Ancona (0.05)
- North America > Saint Martin (0.04)
- North America > United States > Texas > Kleberg County (0.04)
- (2 more...)
- Media (0.68)
- Leisure & Entertainment (0.68)
Modèles de Fondation et Ajustement : Vers une Nouvelle Génération de Modèles pour la Prévision des Séries Temporelles
Laglil, Morad, Devijver, Emilie, Gaussier, Eric, Pracca, Bertrand
Inspired by recent advances in large language models, foundation models have been developed for zero-shot time series forecasting, enabling prediction on datasets unseen during pretraining. These large-scale models, trained on vast collections of time series, learn generalizable representations for both point and probabilistic forecasting, reducing the need for task-specific architectures and manual tuning. In this work, we review the main architectures, pretraining strategies, and optimization methods used in such models, and study the effect of fine-tuning after pretraining to enhance their performance on specific datasets. Our empirical results show that fine-tuning generally improves zero-shot forecasting capabilities, especially for long-term horizons.
- Europe > France > Auvergne-Rhône-Alpes > Isère > Grenoble (0.04)
- North America > United States > Maine (0.04)
- North America > Saint Martin (0.04)
Structure-Blind Signal Recovery
Dmitry Ostrovsky, Zaid Harchaoui, Anatoli Juditsky, Arkadi S. Nemirovski
We consider the problem of recovering a signal observed in Gaussian noise. If the set of signals is convex and compact, and can be specified beforehand, one can use classical linear estimators that achieve a risk within a constant factor of the minimax risk. However, when the set is unspecified, designing an estimator that is blind to the hidden structure of the signal remains a challenging problem. We propose a new family of estimators to recover signals observed in Gaussian noise. Instead of specifying the set where the signal lives, we assume the existence of a well-performing linear estimator. Proposed estimators enjoy exact oracle inequalities and can be efficiently computed through convex optimization.
- North America > United States > Washington > King County > Seattle (0.04)
- North America > United States > Georgia > Fulton County > Atlanta (0.04)
- North America > Saint Martin (0.04)
- (3 more...)
Generative Modelling of Structurally Constrained Graphs
Graph diffusion models have emerged as state-of-the-art techniques in graph generation; yet, integrating domain knowledge into these models remains challenging. Domain knowledge is particularly important in real-world scenarios, where invalid generated graphs hinder deployment in practical applications.
- Europe > Switzerland > Vaud > Lausanne (0.04)
- North America > Saint Martin (0.04)
- Information Technology (1.00)
- Health & Medicine > Therapeutic Area > Oncology (1.00)
- Health & Medicine > Pharmaceuticals & Biotechnology (1.00)
- Health & Medicine > Diagnostic Medicine (0.69)
- North America > United States > California (0.04)
- North America > Trinidad and Tobago > Trinidad > Arima > Arima (0.04)
- North America > Saint Martin (0.04)
- (3 more...)
- Asia > Middle East (0.14)
- Africa > Middle East (0.14)
- North America > Canada > Quebec > Montreal (0.14)
- (13 more...)
- Government (0.92)
- Energy (0.68)
- North America > United States > Georgia > Fulton County > Atlanta (0.14)
- North America > United States > California > Los Angeles County > Long Beach (0.04)
- Oceania > Australia > Western Australia > Perth (0.04)
- (15 more...)
Generative Modelling of Structurally Constrained Graphs
Graph diffusion models have emerged as state-of-the-art techniques in graph generation; yet, integrating domain knowledge into these models remains challenging. Domain knowledge is particularly important in real-world scenarios, where invalid generated graphs hinder deployment in practical applications.
- Europe > Switzerland > Vaud > Lausanne (0.04)
- North America > Saint Martin (0.04)
- Information Technology (1.00)
- Health & Medicine > Therapeutic Area > Oncology (1.00)
- Health & Medicine > Pharmaceuticals & Biotechnology (1.00)
- Health & Medicine > Diagnostic Medicine (0.69)
- Asia > Middle East (0.14)
- Africa > Middle East (0.14)
- North America > Canada > Quebec > Montreal (0.14)
- (13 more...)
- Government (0.92)
- Energy (0.68)